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PURPOSE:To properly and visually recognize your own vehicle and obstacles around the vehicle even if the 
position of your own vehicle is slipped off from the visual field center of a camera. 

CONSTITUTION:Obstacles and parking areas which are hidden due to the image deformation of your own 
vehicle, are properly indicated by synthesizing an image the deformation of which has been corrected 
(coordinate transformation) in response to the position and direction of your own vehicle, and an image of other 
areas excluding your own vehicle, by a whole image synthesizing means 109 so as to be displayed wherein the 
aforesaid position and direction of your own vehicles outputted by a vehicle coordinate transformation means 
105, a back ground area extracting means 107 and a vehicle area synthesizing means 108 after your own 
vehicle has been extracted from an image photographed by a vehicle extracting means 104. 
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1 

ttffiTS£Sn£II*£Ett-rs£ 1 ©@«Ett#a 
35 2 ©Steffi? at. MESS 1 ©EISEfc* aKEtt 

ICKT •£> £^ 7 ;* £ LTEIt L T*5 < A< 7 

/-^Ett^at, irE»ttan&*Poffi«£ffirE''t7 

Ett^ a©&^ 7 * C£-3t>T*K.t#* S 

«#aic«k r)««snfc*p««&»< itrEftiiisnfc 

*P5ffi«£i3ESg 1 ©HfftEfi^afcEttSttfcBftS 

^ a ic «* * «« t &tzitamw?i8.¥mz i&mmt* 

cfc^H»i. li3ESI2©II«Ett#«l::EttanfcB« 
H. 

[fg9J©S«fflfcffiW] 
[0 0 0 1] 

*B543j:tf-?-©ffiH©ttffi£i8«U -?-(DS*ffi®li 
[0 0 0 2] 

<&H¥4- 1 2 3 94 5^f|lCPi*$nT^ 

•5 r»K^«B->xxAj a***, rnii, e$«© 

[0003] 

* $ ns «t ^ c* tt hsssh ic * o x 
«. yj^7t*9st©(4s©«ffiic«to. miht: 

H2 9lCS-Ti5»C, £#«|2 9 0 1 £±#rt>6ffl«!L 
(a) ©i5IC33r«:ift2 9 0 l©H±IC*p<7 
OWB+M 9 0 2#Bl£HftlTfr>S&*fctt&4Mb 
2 9 0 l©Jg«*iE«fcffiASC:i:*«T€r2>^. (b) 

❖ (c) lC;Sf.fc'5Kj£{M&2 9 0 1 t**7©ffi»f> 
•02 9 0 2«tfnTW5«^, *±*>e.l!.fc«£i::$3tt 
-5 (a) ©B«£ftfc0. *P*t£A/rjE.AS. 

[0 0 0 4] Z.(D£o\Z, e*PSti»S£t>^fi#«rC 



(2) 4$ffl¥7-l 9 5 9 7 8 

2 

2^7CH«±IZ*5l/>T*^7ti»P©fi;fi 
*t-rni CltlCiD. *MJB«©S**t554L, 

ft. 

[0 0 0 5] C<D%mt, ±EK«*TfcSnfc<b©T 

aboT. *^7©ffi&+^c^LTa*si©fiH*irn 
fc«&T*^Tfe, a*Ps*«kt;-?-©«ffl©Ris«n&w 

*IC«ST# -5 <k o irr * E £ £ s wtr 5. 
i0 [0 0 0 6] 

[MS£#ft-r*Jfc«>©#Ha] ±E©l«£3j£-$-*fc 

s^T, e*p^??«L^^«j8TaK*nfcH«*E 
ttt-r-ss i ©PttEtt^at. a*Pj*t#ftrs«5BT 

JB»^n:tH«SrE©-r2>S2©ia«E1i^ai:. UE 
|g 1 ©BttEfi^&l::Effil,fcil&Bft^S«ffi&tt& 

a» <tsaEaa^a©»attffifcH-r*ffi$£ : f«>/'<7*- 
^tbTE«LT*5<y^^-^E«^at. iaEata 

$ nfc»55®«S:t8E^ 7 ;* - *E«* a©6-* 7 J* - 

g&^a-t, K*PSM®^ift^a^<koa5ft3nfc*pi 
iaEatbsnfc*pfli«*WEm 1 ©b«e 
ts^a icEft * nfc@« &J8 v>x«^r s#s«8ffr£ 

«ff fiS#aiC«t *E« £ ££j£"r S*P5««£lS^a 
KrEiiipB««£i£¥ai;:J;5B«£, t8E£2©H 

«E«^aicEttanfcBtt*>et&Eiiiw«#£&^fc 

H«t«r^dc-rs*®B«^^at*Afflr<bt>©T 
*<&. 
[0 0 0 7] 

is, a#LfcB«a>e>g*P5£«itHu ssaijifficoteH 
^ifij€r»c«:i;TS»©s*4tiE &*ffbfc 

^?ZCt\z£r). S»P5©S*lc«koTianT^&|S| 
40 [00 08] 

&mm bit. r©»^ic«4*p5«iia^KH©- 

5E?ffiCTS:aWEffll;S^^TKi?!-r-5. H 1 IS, d©» 

^HT*D. Hlt^^T, 10 1BTV*^79SIU 
T£#»ftfc-rs®«©@tt£Aa-r*H«A*8K 
(RT, *^7t^: WflFa*©«H»C*lt5aK^ 
ar*5) , 1 0 1 0 1 fc«kDA*S*XfcK 

^^Efi-r^Btt^'&U (A) (4$Sm$©«H(C«(t 
1 ©@ttEtt#aT$>£) .10 3 litl«!S«rtlC 
50 :mt£$P5©£&&&tttf*«ffi&ffl£B. 10 4«S 
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3 

©«HIC*tt**Pi®*ai&ffl^8T&2>) 
[000 9] 1 0 5»4$ffittffl8Hl 04ICi-5 

&■&) , 10 614®***'; (A) 1 0 2 ilUS&ttig 
@1 0 SA^CAAfcS^TBfc^'J (A) 10 2 
KfcttSBftSEttTS**. &S<,>l4EttLT*S@tt 

s8t«UTB*f*B«;**»j (b) mvtmxvm® 

lC«rt«« 2 ©B«Ett#8T&S) .10 7 
tUSSl 0 44iJ;tm«^ ; EU (B) 10 6^&©A* 

[ 0 0 1 0] St, 10 8 l4*ffiggg»8H 1 0 5*3 

•fcimasstttagfli o 7*^oA*ics^^T«ft 

SI$0ffiglC&t***ffi£8&£^gT&&) ,10 9 

ttn«/^ «j (a) 102 txmm*&amw 1 o sa> 

6©A*fcs-3v>-ca:a&©*p«:£A,jt*£®B&sjs 

±mmnL^&^&x$>!£>) , 1 1 oiiBtt^^u (a) 

1 0 2 i*W8tii8fi 1 0 3 i±Hffi£<£gffi 109* 
e>CDAAlCS^^T^«B«Sa*1-<b*\ A*B«* 

tBa-r^safc-rstttaaiRSB. 1 1 1 ata^a*? 
gffli i o©a:*j£2nrr*a£<igff mmxam 

iCfctt-SSM^Bre**) , 1 1 2l4£ffiKBl 1 1© 

masse-rasmsB «$«pii*©«!HK:*^*sm 

^gT?&*) , 1 1 3IS§fggBl 1 2©g«Btt£S 

[0 0 11] ifc. 1 1 4li ; f'»»«)T*6*P5©BS 
Sit*!*?^*/?! 0 1 ©KfffcitfSft/^ 
;*-*«£EttLTi5<&a©^7*-*Ett£a (ft 

*. 

[oo l 2] ttmco^TRWfs. H2tt, 
©36WK«**ffi«ii$sgH©fflaftfe©$!*jF-r7 

t, ffl»i«^a*ssffrs (S20D . £©«j»ik 
jgtt. e**©±#irFfiSKis*w&nfcrt 
> 7 1 o i b**©***®**®***'; 

(A) 10 2fcA*T*. IDSSKSTtt, 

[0 0 13] SeiC, Btt^^iJ (A) 10 2ICA2JU 
fcEfc&BtMtU (B) 1 0 6 lcffl*f*. ±EX-r 

2 o i iciijaaBtto-BPSBSfc^r. *w 

T, ±EfiJ»K£©£. ®«£ 1 ttA*f*HttA*ffl 
afc&fTf* (S 2 0 2) . B9I4, C©®«A*ffla 
©WS^fbOT. »U>®««:B«;**'J (A) 10 



(3) &H¥7-1 9 5 9 7 8 

4 

2 It, 3 3ms e cWBBTA***. fc*3. Z 

©«£fc*tt*B«©*$;*tt, «A»4\ © (HN) 5 
1 2X13 (VN) 4 8 0®$tf*. 
[0 0 14] mz, ±EXxy^S 2 0 2©B«A*© 

a. gaaaasgfr-r* (S203) . i©g^fflar 

14. *Pattfflgfi 1 0 3 \ZtS»T, B«**'J (A) 1 
0 2rt©B«f (x, y) iBfc^'J (B) 1 0 6 A 
©B«g (x, y) \ZMLX. 
A f (x i. y J) = I f (x 1, y J) -g (x, 
10 y) I 

S*tiif-&. HI Ott, £©8#ffl3©8l£jK-fB{rr 
»0. Bift^'J (A) 1 0 2*>SB«.* : EV (B) 1 
0 6£3I3*U KJ£«THliD^#^fi*t)t3B* 

©«*i, -ettetft-fcoi-r*. 
too 1 5] ae.fc. *w*«fip«rr%*g*»sw»r-r-5. 
(S204). *w«aisai o 3tc«ko, 

2ffi{fc3nfcB«£jfeS£LT 1 tfSRLfcfcfcftfc* y 
7,9 V>*f SgfrU B*7**©StfBJ**« 

^i&KfcL&HffiTH 26l±CKST<b««Sr*WT?* 
a? St«»-r<b. C©7f«^S 2 0 4»Cfe<-»T, *®*» 
#«Ef •Stf.lSrLfciSKtt. SPJSlttiSfil 0 4KJ: 
0 2ffl^H«T*PT*-5tW»rSnfc««©H«^ ; & 
>J (A) 1 0 2rt©B£S8&fflffl-r* (S 2 0 5) . 
[0 0 16] *P5&gg&&Bl 0 5lC«fcD. 0 

3©7a-?-\—Mcw-r«t5!4ffi«jffi8ic««ia (» 

SB) Sgff-r* (S 2 0 6) . HI 514, C©ffigg« 
K:<fc<&a:»fflaffl©*®««B«, HI 614, 

ffla&©nm««B«T**. ::tii, ♦BtrJi- 

[0 0 17] ft*KI*£ffl(i)gfB 1 0 7 (C«k0. 

Bft^t'J (B) 1 0 6±l::*$tt*£«E©»P5«8«tt 
Hit, «*««£f-5> (S 2 0 7) . 01 714, d©* 
M««©^«S^-rBHTJbO, Btt^t'J (B) 1 
0 6rt©*P««K*&.5£S©H*©»«fc«:-?-©* 

*©ttffiT«ftH«tLTSiiirr*. Ratbsn&um 

B«tt. *El;ISnTV>fc»SfctfS$n&B«ifc 

40 [0 0 18] 81>T. VPie^^SBl 0 8l:£D± 
E7.x5/ys 2 0 6TSJft3tXfc*MB»t±EX'ry 
^"S 2 0 7 IC«t*«»««i:S:^etUr*P««S^ 
f4 (S 2 0 8) . C©^<S»»»4. «*«*©±ffifl 
fflT«^Btt«t2«lft<b$fi-r««^(Ci4. *Kffie& 
S^L, -C-©ffie(fi%BlKffla:-r«. £fc. «PBtt«< 
«V)«^lcl4«JMI«&a^-r-&. C©fflSUS5:Hl 
8 IC^To JliTB. HI 6C*tfc««a©»?5«« 
i. HI 7»c*bfcttffi*n&«aBfc£*£fiE-f*. 

» <J4ofcffiS»:»LTSftB«©B-ffie©»Stt€:* 
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5 

[0 0 19] frlZ, £@E£(£g«l 0 9tC<fc9±gEX 
x-y^S 2 0 8fcfc^T£jS3*lfc*ft®«&Hft;** 
U (A) 1 0 2.l»i©H*»c£J«T* (S 2 0 9) . d© 
Slfc^fcli. *PS«8©£gSffiST-?-©lI**$Iii« 
**'J (A) 1 0 2©@3HI£fi£«A.&. -t©te©il 
g<fcHT«B(fc;*t'J (A) 1 0 2©H*ffl©**©« 

f. 

[0 0 2 0] ffcfcS, HI 8lCSUfc«I< 
»K®«&Dl»J**'J (A) 10 2Oti«iC&«t 
•5. &SlS;*nfc»P5««l;iiI«J*^U (A) 10 2© 
»P5ffi«i:Hi;fc8fc©T, Hft^tU (A) 10 2© 

[0 0 2 1] ■?•©«, ttiaS&SH 1 1 0 D*P8© 
#ft-r5«£te£@fl5£fS8B 1 0 9 C«fc5-SjS@«£ 
SKU SPW^fcLft^ttSfcttH***'; (A) 1 

0 2±©@tt&jgftL. cn&©a^n&p«S:^€ 

SHI 1 llCfcOSftSfflHTgmSfil 1 2lc2flf 
* (S2 1 0) . 

[0 0 2 2] ±E^7 l i/^S2 0 4«C*V»T. * 

ij (B) 1 0 6*Xt!T«*9*ftfMrr-« (S 2 1 

1) . HtMt'J (B) 1 0 6»C:fe^T£>5 

7,9 'J >^;SnfcH«rtT*7X*©£tlB*aiR£H 
ffiTH3 (TH 3 <TH 2) ± D£V>* 7 

*Mftft#fcD£«SrLTH«;**U (B) 

1 0 6 ©KRSfrfcfcl^. 

[0 0 2 3] L&attjT. ±EX5 L y7S 2 1 1 IC*^ 
T, Htt^t'J (B) 1 0 6£MSrL.&V>i*!lKLfc£ 
Sfcfi. iiE^y^S 2 1 0©fflSt»frU E«X 

(b) i o essgSr-rstwwufct^ttt, R$ 

**»J (B) 1 0 6©MSr£SSfrl<fc (S2 1 2) 
±E*xy:/S 2 1 0 KafrUTHft S^HTTS. 
[0 0 2 4] H3I^Lfc7D-^V-HcS^ 
HT. iE^ff^S 2 0 6 iCfc^Tgfr? 



(4) ^88^7-1 95 97 8 

6 

f<fr4 0 1 ^b«ia$n/t$Sffi«4 0 2©g$£fT 

i\ $p««©jig{©^^e§t>fBn^ (fijS/S4 

0 3) £ttSBf* (S3 0 1) . d©&j§£4 0 3 \ZJ\ 
(HI 2 £18) SffK *fi£-f48#S*HJ-r 
4. ±ESaSC:<fc*fijSj&4 0 3©»SII««:B1 1, 
*P|X;,v>©fcttifl|£Bl 2K*T. C©i5IC, ftjg 

.£4 o 3iattfflsnfc*ffi®«©EB«c*taan*. 
[0 0 2 5] ssic. *w^rsjs*taf-5 (sao 

2) . HCTtt; *Kti'7^^Snfc2filfl:S«©« 
J0 «©ffi<kS»tfi1-«>. 2<i>©ttB&S (xg, yg) i 

itofcTEicko**, 2fflft$nfc»pi©[6j#sjmi 
-rs. hi 3e. c©*ffi*(Rj©»taw^r , b©-c» 

*i*pg©ifi]#-c*i. 

[0 0 2 6] T1Zt>*>, *Wffi««fflKB 1 0 4 let 0 

aHi^nfc^asrv (i, j) trzt. te©si£ 

[0027] 

a) [sen 

HM VN 

moo = Z X V ( i , j ) 1 

HN VN 

m„i = 2 i Z V ( i , j ) (1> 

VN HN 

mio = S j I V ( i , j ) 

30 

[0 0 2 8] *LT, S-kW&BffiS (xg, yg) 
\i. 

x g=m;o/moo, yg=mio/moo • • (2) 
ttiZ>. 

[0 0 2 9] Sec. V (i, J) £±EE<C>©<fl:fiffi 
£ (xg, yg) **JiS*©JS^t*«.i5IC¥^ft 
£fr5. VfrgftLfcHiftSV, (J. j)fT5t. 
V2 (1, J) =V (1-xg, J-yg) • • (3) 

tuz. 

40 [0 0 3 0] 
[»2] 
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(5) 



#S¥7-1 9 5 978 



m 20 — 



HK 



VN 



V ^ ( 



j ) 



m 



02 



HK 

= £ 

vrr 

= L 



VN 

I 

j'O 



V 2 ( i . . j ) 



BN 



j I V , ( i . j ) 

1=0 



do = 



2 



tan 



2 m ji 



[0 0 3 1] ±ER 2 D , 1Stt©±«iro*eSIJ. 
1=J • t an0o • • (5) 

±E (3) «Tff^fc¥ff»«l02»a 

i+xg= (J+yg) -tanflo •• (6) 

tO 0 3 2] ±iEXf«^S 3 0 2©ffi8*gfTb& 

a. wax-y^rottaissiffr* (S303) . zzr 

lC.fcB:RaStl&«#©£A«:3R«>. C©2£©S<&tS 

*ffit(lt*©Xy>?Src** 
*C. HI 4l^'Ti'5lrttaX5;i?«tS!^©*-5» 
»Sr<B^X5/^i:r5.fiJ^Xyi?©ttmS:Slffr* (S 
3 0 4) . £©*£, Xyv?«a:S«^©Jb.5«^S:A7 

[0 0 3 3] *PS©(RjS*»fflT-5 (S 3 0 

5) . -rfctotS, ±E»#©gS£J*fflU *P5©8!& 

(a/2xi • (x« -x 

<koT, 

X= (a/2x. • f) • ( 
Y= (b/2y. • f) • ( 

[0 0 3 5] tfc. H6B, ♦Ptx^Sr^-TSlPHT 
JKDtxJUi, ytt^[6llC-^ew*"b^. 1~ 

1 2©»»»Si©3J>C7cffiSS ; tx;l'tUT ; f«)A7^- 

*E«8Hl 1 4lCE16LTfc<. 
[0 0 3 6] Jfcfc. »P5tx;i'©a:«IJa31€r^fTT-5 
(S 3 0 6) . HJL-Ctt. «j£$n^:*K©|BlSt*p 

w«©xyj;et-tnii»Rsn/s:e»fsai:. 

1 0 1 ©KHA^-^a^TEfcjS-rBBffiCSffl^ 

[0037] w^txiWfaro^ra^oafi] h« 
x)^#6nfc$Mtaa©xyve±©2^ (x i. y 



m — m 20 

j|x»tt©ga«£«©g3£B?TH*. »»©»££ 

U £»©fiS *P5©*7\>H«fffilK 
EftUTfc<. ft*, CO^jttt. 06 (ftifi) fcj* 

sn*<t'5a«a*"bofct>©T**. ^©^xJMsai 
[0034] etf, ±E»cfei-t-6saas»jfi-r«. as 

<&©T**. Hftf (x, y) fciiHT. (xl. y 
1) ©ffiS©ifij6*»e>©»ax)it 2©«£. 
0 l*Jft±©£g©iSC&i:f *£, CO (xl, yl) 
». SS±©ffig (x 1. yl, t 1) tLTTE (7) 
C*0«ftSn*. ft*, #*7©fcj&miB«f, 'ftft 
50 B90' P IBt-fXttlaxib, KHSSHtf 
5. T ftfcS. 

1) ) /f = x 1/ (H- t 1) 

x. -x) • (H- t 1) 
y. -y) • (H- 1 1) • • (7) 

1. t 1) , (x2. y2, t 1) £B«L, ££ffltC 
±E (7) jt£ffl^Tg«T*. ft*. z»B*0X-ft 
ft ytttS«©Yffig. tlBfltTMttT&I* 

(x 1. y 1. t 1) . (x 2, y 2. t 1) ©£££ 

jiiht. moxgsett-rsiies i£#a*. -tft 

01=- (x2-xl) / (y2-yl) • • (8) 

[0 0 3 8] a sic <a^rx 5 'i;«±©2xa*»e*)^« 

lC*p©ffl#0 2 £ £©2 0©« 

50 [0 0 3 9] »Pata«©Xyy»£<H:&XyS>e©2Ll& 
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(6) 

9 

£ (xO, yO. tO) t?Zt. £©ffig©£$fgg * 
g(xO, yO, t 0) ifi : £7 ; )UD#m&tft&-rzt 

tzt. a6ic^ufc*Pi*7 : ;i'©4$a^©-5-& i. 

2, 11, 1 2<D<sitXfrimi&tZ>£t\ZtiZ>. £©5 

n, rn«««©s*tr-5. -tLTS*j6*tftjrr* 
[0 0 4 0] aeic, ftlSMilBj-r, 

x3 = nA t/ (t 2- t 1) 
y 3 = nA t/ (t 2- t 1) 

[0 0 4 1] C£gM&£©iatt£8^©£& 

x = x» - (2 x« f /a 
y = y i - (2y. f/a 

[0042] as a ins©*™ m»mmiz&&2t\iz 

a^«tl/«86ffig© l b^H3«Sffl s F^fillCfflS-r5 

(x 1, y 1, t 1) , (x 2. y 2, t 1) , (x 

3, y 3, t 2) , (x4, y4, t2) *©«f> 

(t 1 + t 2) /2 ■ • (11) 

[0 0 4 3] ±8EX^«;/:/S 3 0 6©ffi3SS:^ffLfc 
«. HftffiSOXttffla^ffU (S 3 0 7) , 'J*- 
>-T-5. ClfflX^-V^S 3 0 7Ttt. #P««!S«ffliS 

©*2m-ii«£fttt. »3©a5«#s:a±ri>e>*fc 

H«i:£»f **>©?**. $$M&8 (xi, Yi. 
t 1) iCfe^T, t 1 = 0 tVX, ±EXf7^S3 0 
6©®©£tt«ffofc£tt-C»*. LfctfoT. ±E 
(1 0) 5£<fcD, 

f/aH) -X 
f/aH) • Y- • (12) 



7-195978 



10 



7B, d©aaffie©a^&j£6*-rRWHT»i. 2 
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